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A sample function from one of two stable, stationary, independent- 
increment processes is observed for a finite time interval. For differing 
location, characteristic index, skewness, or scale, the probabilities measures 
induced by the process under either hypothesis are found to be mutually 
orthogonal. By suitably modifying the Levy measure associated with each 
probability measure, continuous-time tests for differing characteristic 
indices, skewness, or scale parameters can be posed as nonsingular detec- 
tion problems; distinguishing location remains a singular detection 
problem. For the nonsingular problems, the likelihood functional is 
found explicitly, and performance limitations are determined. As an 
alternative approach, the observed sample function is sampled at discrete 
time instants over a finite time interval, and the performance of log likeli- 
hood test is studied as a function of sample spacing with a fixed, total 
number of observations. 

I. INTRODUCTION 

In this paper, the work begun in Part I 1 on discrete-time hypothesis 
testing of stable probability measures is extended to continuous time. 
In contrast to the earlier work, analytic closed-form expressions are 
found for both the log likelihood functional and Chernoff-type upper 
and lower bounds on various error probabilities for the log likelihood 
test. As in Part I, the singular role played by the gaussian probability 
measure within the family of stable probability measures is em- 
phasized, both in terms of the form of the log likelihood functional and 
the expressions for Chernoff-type bounds on error probabilities. The 
earlier work dealt with observing N samples from a stable process 
with one of two sets of parameters at time instants At apart ; here, we 
fix the observation interval at duration T, and allow the number of 
observations to become infinite while the spacing between samples 
shrinks to zero (N — *<», At — > 0, such that N ■ At = T). 

Section II briefly reviews some properties of independent-increment 
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processes and infinitely divisible distributions that were touched on in 
Part I. Section III draws on this tutorial material by considering an 
elementary hypothesis-testing problem for discriminating between two 
Poisson distributions with differing parameters.* Section IV briefly 
reviews some work by Newman 2 - 3 and Newman and the author 4 - 6 on 
calculating log likelihood functionals and Chernoff-type bounds on 
error probabilities for the path-space probability measures induced by 
independent-increment processes. These results are used in Section V 
to show if one or more of the parameters of the two stable-probability 
measures (0 < a < 2) differs, then the two path-space measures are 
mutually orthogonal. Section VI develops one remedy to this so-called 
singular detection by modifying the L6vy measure of the two distribu- 
tions to account for the real physical limitation that the process can 
only be observed to within an accuracy intrinsic in all measurement 
apparatus. Section VII considers a different but related issue, where 
the observed sample function is sampled at discrete time instants over 
a finite time interval, and the performance of the log likelihood test is 
studied as the sample spacing shrinks to zero ; this allows one to trade 
off the sample spacing, or the rate at which samples are observed, for 
the total duration of the observation interval, or the total number 
of samples. f 

The results developed here are novel in that one can immediately 
ascertain explicit bounds on the performance of the likelihood ratio 
test, while it is not clear how to do this after reading the literature 
(e.g., see Refs. 6 through 10). The method of proof here relies on 
probabilistic semigroup tools or on the explicit nature of the sample 
paths of an independent-increment process, and this appears to be 
novel when contrasted with such approaches as those referenced above. 

II. MATHEMATICAL PRELIMINARIES * 

Let Tj{t) (j = 0, 1) be a scalar real- valued random process, with 
right continuous sample paths with left-hand limits everywhere de- 
fined. More explicitly, let ry(i) be the sum of a deterministic drift 
process, b s t, and N independent Poisson processes (labeled by k, 
1 ^ k ^ N), where each Poisson process has rate \y* and hops of 
height h jk . In words, r/(0 has simple jump discontinuities of heights 
hjk, 1 ^ k ^ N, at random times. The characteristic functional of 



* The results in Sections III through VI were first announced in Proceedings of 
the 13th Annual Allerton Conference, University of Illinois, Champaign-Urbana, 
Illinois, October 1-3, 1975, pp. 234-239. 

' The results in Section VII were first announced in Proceedings of the 1976 Johns 
Hopkins Conference on Information Sciences and Systems, Baltimore, Maryland, 
March 30-April 2, 1976, pp. 151-154. 

x See Ref. 1, Section 3.1 and its list of references for much more information. 
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Tj{t) is easily seen to be (t > s), 



^gii>[ry(t)-r,-(«)] j — ex p 



(i - s) \iv8j + J^M***' 1 - 1)1 J 



If we now pass to the limit of an infinite sum of Poisson processes, 
then the jump amplitudes [hjk\ take on a continuum of values, and 
the characteristic functional becomes (t > s) 



2j[y.[r,-(i)-r,-<t)]] _ exp 



(t - s) UvBj +f (e ivu ~ 1)«M«)]| , 



where v is called the Livy measure associated with the path- 
space measure of r,-, and generalizes the rate parameter set { Ay* } ; 
(t — s)J] i ^ A dvj{u) is the expected number of jumps of r } - whose 
amplitude falls in the set A, in a time interval of duration (J — s). 
LeVy and Khinchin showed the following remarkable generalization 
of this heuristic development : 

Theorem (Ref. 11, p. 76) : Let rj{t) be an R n valued random process 
with independent increments. Then 

E(exp \w™[Tj{t) - rj(s)l\) = exp J (t - s) \iv T Hj - \v TR SjV 

where 8, £ R n , Sj is an n X n positive semidefinite matrix, and 

u TR u 



I. 



u *0 1 + U TR U 



dvj(u) < oo. 



In words, any independent increment is the sum of three independent 
processes : (i) a purely deterministic drift process, completely specified 
by 8j, (ii) a purely nondeterministic gaussian process with zero drift 
and almost surely continuous sample paths, specified by Sj, and 
(tit) a purely nondeterministic jump process with zero drift, a 
sum of independent Poisson processes with different rates and jump 
amplitudes, specified by vj. 

Historically, the mathematical study of independent increment 
processes concentrated first on the purely gaussian case (vj = 0) ; then 
on the purely stable case (Sj = 0, dvj = dn(d)dr/r a+1 , < a < 2, 
where n is a positive measure on the unit sphere in R n and [r, 6~\ are 
polar coordinates in R n ) ; and lastly on the general case, building on 
the insight gained in the first two cases. 12 A second reason for wishing 
to study the gaussian and stable (0 < a < 2) probability measures is 
that they arise naturally from studying limiting distributions of 
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suitably scaled and translated sums of independent, identically distrib- 
uted, random variables in the central limit theorem, and have found 
application in modeling noise in communication channels such as 
telephone lines. 13 These two reasons, as well as others, provide the 
major impetus for the study to follow. The richness of the structure 
of independent increment processes suggests they may find more and 
more application in model building as their properties become more 
widely known. 

III. DISTINGUISHING POISSON PROCESSES 

In this section, r,(i) (j = 0, 1) is observed on the interval [0, T), 
and is the sum of a purely deterministic drift process (specified by 5/) 
and a purely nondeterministic Poisson process (specified by rate X,- and 
jump amplitude hj). What is the log likelihood functional, and what 
is its performance? 

First, suppose the Poisson process has the same jump amplitude 
under either hypothesis, but the drifts differ. Then it is straightforward 
to show that the two probability measures P and Pi, associated with 
Tj under hypothesis Hj, are mutually orthogonal, so (i) observing r 
over any finite interval, the log likelihood functional takes on the 
value +oo if Hi is true, — °o if H is true, and (ii) the probability of 
incorrectly choosing one hypothesis when the other is true is zero. 
The reason for this is clear on physical grounds : the Poisson component 
has constant sample functions with simple jump discontinuities at 
random times, while the drift process is continuous with constant 
slope. Thus, ignoring the jumps in the observation process, the slope 
of the continuous part of the sample path is Bj, and to discriminate 
between the two hypotheses is now trivial. From this point on, there- 
fore, it is assumed Si = 5 and, without loss of generality, set 
5y = 0(j = 0,l). 

What if the Poisson processes have different jump amplitudes? As 
soon as one or more jumps occur, it is possible to discriminate per- 
fectly between the two processes, since the size of the jump hj is 
associated with hypotheses Hj. To avoid this indeterminancy, it is 
assumed from this point on hi = ho = 1. Thus, Po and Pi, the 
probability measures associated with Hj, are mutually absolutely 
continuous. 

Lemma 1 : Let r,- be as just defined. Let 

p; ["(nr r )l r '(» r )]' 0*** — 1 "-* 1 

denote the conditional probability of rj at time [(fc + \)/n~\T, given rj 
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at time (k/n)T. Then [^(0) = a.s.; j = 0, 1], 

(i) A = In ^ (r) = lim Z InS (r). 
(ti) # 9 (P„,Pi) = lim [ff,(PiP0>- 

Proof: The proof follows from standard limit theorems (Ref. 7, Lemma 
1.1), Q.E.D. 

We now explicitly evaluate the limits in Lemma 1 : 

Proposition 2: Given the conditions of Lemma 1, 

(i) A mj* { - (Xx - Xo) + £ [ ln (xo)] 8 ^-^}^ 
= j* [-(Xi - Ao)<tt + In (M dril , 

where iV r is the a.s. finite number of time instants [tk\ where 
r t changes state. 

(ii) F 9 (P ,Pi) = exp {-TlqKi + (1 - q)\ - XfXS-']}. 

Proof: 

(i) Given r ; - at time (k/n) T, it will remain in that state in the next 
time interval (T/n) with probability 1 — \jT/n + o(T/n), and 
will increase by one with probability \j{T/n) + o(T/n). The 
desired result now follows Lemma 1. 
(ii) If Tj changes its state in the next time interval of duration 
(T/n), then 

H q (P' Q , Pi) = \ XfXT* + o(T/n) ; 

it 

while if Tj stays in its present state in the next (T/n) time 
units, then 

H q (Po, Pi) - 1 - ~ [fri + (1 - ff)Xo] + o(F/n). 

.-• ff,(Po, PO = exp [ - | (g\i + (1 - 9)X - XfXj" 9 )] 

+ o(T/n), 
.; H q (P 0) P{) = exp { -T[gXi + (1 - <?)X - XfXj-*]}, 

where the last step follows from Lemma 1. 

Q.E.D. 

Recall from Part I that a crude bound on the total probability of 
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error P E for a log likelihood ratio test is provided by 



\ min (ti, tt q )H\ ^ P E ^ Vtti, iroffj, 

where *-j is the a -priori probability hypothesis that j is true. Here, 

Hi = exp C-T(V\i - VXo>/2] 

and hence for fixed T, one would like to have the difference in the 
square roots of the rates as large as possible. 

To gain further insight into H q (P , Pi), we rewrite it as the ex- 
pectation of a third Poisson process. Let x q {t) be a Poisson process 
with rate XfAo -8 , hops of height +1, and £ 8 (0) = a.s. (intuitively, 
the probability measure P q associated with x g has support on the 
common support of P and Pi). 

Proposition 3 : 

H a (P 0) Pi) = j dP q exp | - j* Dlx q (t)W, 

= E Xq (exp | - j* D[aR,(0 ]*N , 

D(x q ) = q\i + (1 - q)\o - X?Xo -8 . 

Proof: The proof follows from the definition of D, P q , and x q . 

Q.E.D. 

To the best of our knowledge, this result is new, and will be generalized 
in the following section and elsewhere. 4,6 Its significance lies in the 
fact that there exists a large body of results in both the mathematics 
and physics literature for studying properties of expectations of 
multiplicative functionals of random processes, so called Feynman-Kac 
functional ; now we can immediately draw on this body of knowledge. 

IV. DISTINGUISHING INDEPENDENT INCREMENT PROCESSES 

In this section, the results of Section III are extended to arbitrary 
independent increment processes. Here, r t ^R n is observed over 
[0, T), and has one of two sets of parameters (dj, Sj, vj) ( j = 0, 1). As 
before, define for < q < 1, 

H q (P 0) Pi) = Jdh q (P , Pi), 

where H q is the Kakutani product associated with P , Pi- Next, it is 
useful to define a nonnegative measure j q (v , fi) [the generalization of 
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the point measure at +1 with mass gXi 4- (1 — g)Xo — MK " in 
Section IIIJ, 

rfi«("o, vi) = gdv\ + (1 — q)dv - dh q (v , vi) } 
J*{vo, vi) = / dj q (v 0> v\), 

and J q is nonnegative and may be infinite, since vq or v\ or both may 
not be finite measures. If J q < °° , it is convenient to define 

/U 

Finally, if Si = S = S, and J q < °o , a third independent increment 
process z fl (0 is defined with parameters [_5 q , S, h q (v , vi)~]. 

Theorem 4- For P and Pi not to be mutually orthogonal, it is necessary 
and sufficient for the following three conditions to hold : 

(*) J q (*>o, vi) < no 
(it) Si = So = S ^ 
(tit) 5 9 £ ran^e (£). 

// these three conditions are satisfied, then 

(a) A(r,) = f T \ f In ^ (tt)d„r, - /" (dn - dv )di] 

+ 8™S-*lr T - jr - h(&o + *i')l 

where d u r t assigns a point mass at time instants where r t — r t - = u, 
i.e., where r t hops with amplitude u, &ndj t is the jump process com- 
ponent of r t . 

(b) H q (P , P:) = exp [-7V,K *i) - ^q(l - qK R S~^ • 

Proof (sketched) * : The proof is broken into two parts, one part dealing 
with the jump process, the other with the gaussian process (including 
drift). The part dealing with the gaussian component is classical, 6 and 
yields conditions (tt) and (Hi), above. The main method employed 
in showing condition (i) for the jump-process component is to ap- 
proximate the jump process by a sum of independent Poisson processes 
with different rates and jump amplitudes. As more and more Poisson 
processes are included in this sum, it can be shown that the approxi- 



* From a detailed proof in Ref . 5. 
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mation converges weakly to the actual jump process. The Kakutani 
inner product of the probability measures of the approximations is 
simply the product of the Kakutani inner product associated with 
Poisson processes of the same jump amplitude (but possibly different 
rates) ; again, the delicate part of the proof is to show this approxi- 
mation converges to the actual Kakutani inner product of the path- 
space probability measures of the two independent increment processes. 
The program is to use this theorem in the remainder of this paper 
to exhibit the log likelihood functional and ascertain bounds on its 
performance in hypothesis testing for stable processes. Skorokhod 7-9 
has obtained conditions (ii) and (Hi) in Theorem 2, and instead of 
condition (i) obtained two conditions which must hold : 

f (a - l)dv < * and / (g - l) 2 du <«, 

where g = (dvjdvo) ; it is easy to show these two requirements are 
equivalent to J&o, vi) < °° . Hence, these conditions appear simpler 
than those of Skorokhod. Moreover, it is obvious how to use J q to 
determine performance limitations, while it is not obvious at first 
glance how to apply Skorokhod's work. Also, the method of proof is 
different and may be easier to follow. 

Finally, it is instructive to rewrite H q as a Feynman-Kac type of 
functional of x q : 

Proposition 5 : Let x q be a stationary independent increment process 
with parameters (h q , S, h q ) as defined previously. Then, 

H q (P , Pi) = E Xq Texp (-//^W*)] 

= jdP q exp [ - j* D{x q )dt] , 



where 



D(x q ) = ff(l - q)5^ R S- 1 8 q /2 + [ dj t . 



Proof: The proof follows immediately from the definitions of D, x q , P q . 

Q.E.D. 

Again, note that 

dw> = i[(«w<*./ 2 ) +/_ (V| - V© 1 *] ■ -.. -«<■ 

can be immediately used to provide a crude upper and lower bound on 
the total probability of error. As in the Poisson case, one desires the 
differences in the square roots of the Levy measures (suitably defined) 
as large as possible, for good performance. 
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V. DISTINGUISHING STABLE PROCESSES 

Let Xj(t) ( j = 0, 1) be a scalar real- valued representation of a stable 
(0 < a < 2), stationary, independent increment process, t £ [0, T), 
with characteristic functional [z;(0) = a.s. ; j = 0, 1].* 

£(e« n "«>) = exp It \i&jv +j (e iv " - 1 - ^!L-\ dp t {u) 

vj = cL\u\~ a > u < 

vj" = — C$M~ ai U > 0. 



j»,-(m) = 



Following Section IV, it is clear that J q (v , vi) diverges (to + *>), 
from simply substituting in the explicit form for v, and carrying out 
the calculations. Hence, P and Pi are mutually orthogonal if one or 
more of the parameters differ, the log likelihood functional is either 
+ oo or — oo on hypothesis one or zero, respectively, and the prob- 
ability of incorrectly choosing one hypothesis when the other is true 
is zero. 

Since J g (vo, "0 diverges because vj diverges as |u| — ► 0, this suggests 
that being able to observe the process perfectly, down to jumps of 
vanishingly small amplitudes, may be the mathematical reason for 
singular detection ; but therein lies the flaw : it may well be physically 
impossible (the mathematical model is inadequate) to achieve this. 
Frost 10 apparently first popularized this idea in the engineering litera- 
ture ; here we reach the same conclusions by entirely different methods. 
Sections VI and VII deal with two distinct methods for overcoming 
these flaws in the mathematical model. 

VI. DISTINGUISHING PSEUDO-STABLE PROCESSES 

Let Xj(t) (j = 0, 1) be a scalar real-valued representation of a 
stationary independent increment process just as in Section V, except 
that the LeVy measure is now written as 

[cL \u\~"* u < — L 

\'{u) -L <u < 

\{(u) 0<u<R 

— c J +u~ a > R < u, 



Vj {u) = 
where 



and 






The case a = 2 is well known 6-10 and, for brevity, is not included here. 
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A^, X^ are absolutely continuous with respect to Lebesgue measure, 
and vj is nondecreasing on (— » } — ), nonincreasing on (0-f, «>). 
The limit, as both R and L approach zero, of a sequence of such pro- 
cesses can be shown to converge weakly to a stable process, and hence 
these processes are christened pseudo stable processes. Here L and R 
quantify that the fact that no negative jumps can be observed with 
amplitude less than L, no positive jumps can be observed with ampli- 
tude less than R. Both the properties of the sample functions and the 
one-dimensional distributions are radically different here from stable 
processes: (i) pseudo-stable process sample functions are of bounded 
variation w.p.l, with only finitely many nonzero jumps in any finite 
time interval ; stable process sample functions are of either unbounded 
(1 < a < 2) or bounded (0 < a < 1) variation w.p.l, with the set 
of time instants at which nonzero jumps occur being dense in any 
finite time interval, and (it) the set of one-dimensional distributions 
of pseudo-stable processes is clearly not closed under convolution, 
which was the defining property of stable distributions, but the 
asymptotic tail behavior is the same, since 

Pr [*(f - 1) > x} ~0 (j* <Mii)) , 

Pr [Xj{t = 1) < -x] ~ (J * dvj{u)\ 

For this special case, it is straightforward to show that Jg(vo, »i) < °°» 
and hence condition (i) of Theorem 2 is satisfied. However, 8 q is not 
in general in the range of S( = 0), and again singular detection is 
possible. The reason is clear on physical grounds (cf. Section III, the 
Poisson case) : the slope of the sample paths of Xj(t) is h], ignoring the 
jump discontinuities, and hence it is trivial to discriminate between 
two pseudo-stable processes with different drifts. Two approaches are 
available : either let S be nonzero, which we do not pursue here because 
this seems ad hoc, having introduced L, R, already, or make the drifts 
match, 5i = &o, which we assume from this point on. 

The log likelihood functional is thus 

A(f,) = f T dt r f~ L In {d Vl /dv )dr t + /"* In (dpi/dv )dr t 

+ f T dt \ f~ L (-dvi + dv ) + J' (-dvi + dv )] , 

where, for simplicity, it was assumed 

X>_ = cLL-v, X4 =-c>+R- a i. 
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As expected, the form of the log likelihood functional is quite sensitive 
to whether a = 2or0<a<2 (e.g., see Refs. 7-10 for a = 2). 

To obtain upper and lower bounds on the probabilities of an error 
of the first or second kind, and on the total probability of error, the 
Kakutani inner product H q must be calculated. Assuming XL = cLL"', 
X j + = —c{R~ a >, the result is 

H g (P , P0 = exp l-TJ Q ( Vo , wOl 
J 9 (n, n) = q(c l -L-°> + <4fl-«0 + (1 - q)(c°-L-°° + c° + R-°<>) 

_ (q oC °-)i-W-) y gai _ (1 _ g)ao 

qai + (1 — q)a 

_ {a,c\y-*{a,c\y R _ qai _ a - q)ao 
qai + (1 — q)a 



H g (P , Pi) = E xq exp T - J* D(x q )dt 
D(x q ) = J q . 



In summary, discriminating between Wiener processes (a = 2) with 
different variances leads to singular detection, while if the variances 
are identical then the detection problem is nonsingular. 6-10 Discriminat- 
ing between stable processes (0 < a < 2) with one or more different 
parameters leads to singular detection. If the LeVy measure is modified 
to be a finite measure, then if the drifts differ, singular detection occurs, 
while if the drifts are identical, then the detection problem is 
nonsingular. 

VII. DISTINGUISHING SAMPLED STABLE PROCESSES 

The previous sections show that it is quite easy to find examples of 
continuous time singular-detection problems. In this section, it is 
assumed that iV samples of a stable process with one of two sets of 
parameters are observed, and we wish to study the effect of choosing 
the sample spacing and the total length of the observation interval 
on the Kakutani inner product H q ; the goal is to make H q as small 
as possible. 

Attention is confined solely to scalar processes from this point on. 
The distribution of Xj£(k + 1) Ai] — Xj(kAt) is given by Pj(At ; 5,-, Sj, vj). 
The Kakutani inner product of the new two discrete time distri- 
butions is 



H q (T,At) = IjidP^d^idPo/dny-^ 



TIM 



For At i or T— ►<», with (T/At) = N fixed in both cases, fixed, 
that H q can approach one, some number between zero and one C sa y 
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e~ kN , where k = k(&i, 5 , Si, S , "1, "o)], or zero. It is obvious that 
if the two continuous time independent increment process path-space 
measures are not mutually orthogonal, then the only approach to 
reducing H g is to fix At and increase T. However, if the two con- 
tinuous time independent increment processes have mutually orthog- 
onal path-space measures, then it is possible to reduce H q by decreas- 
ing At with (T/At) fixed. To state the result, a lemma is needed: 
Lemma 6. If n is an infinitely divisible probability measure, with 
v(u) ~0(|u|- a ) as \u\ -»0, < a < 2, then 



/' 



exp (ivx)dn(x) = exp [-S|v| a + D(t»)], < a g 2, 
where if 



then 



8-f r-^— 2 dv{u)=Q, 

J UJ 6Q 1 + W 2 

LimD(v)/\v\ a = 0, < a ^ 2; 



otherwise, 

D(v) = ivb + D'(v), Lim D'(v)/\ v\ * = 0, 1 ^ a £ 2. 



|c|-»oo 

Proof: The proof follows from properties of v, and is found in Ref. 5. 

Q.E.D. 

The main result can now be stated : 

Proposition 7: For < q < 1, with a zero-drift gaussian component 
(a = 2) present in either Xi, or x , or both, if (T/At) is fixed 

Lim H g (T, At) = 

A HO 

(a) 1 iff Si = S > 0. 

(b) Exp (-kN) iff Si * So, Si > 0, and S > 0, 
k m In [oOSo/Si) 1 -' + (1 - q)(Si/S )°y. 

(c) iff Si * = So or Si = * S„. 

If a zero-drift nongaussian stable (0 < a < 2) component is present 
in either ri or ro, then 

Lim H g (T, At) = 

(d) 1 iff ai = a , Si = So- 

(e) Exp (-kN) iff «i = a 0| Si * S , Si > d, S > 0. 

(f) iff ai ^ a . 
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Proof: The proof follows from scaling arguments, and is found in 

Ref. 5. 

Q.E.D. 

If a gaussian component is present in both processes, then decreasing 
the sampling interval has no effect on decreasing H q , and T must be 
increased to decrease H g . However, if no gaussian component is present 
in one or the other of the processes, or if ai ^ a 0) then it is possible to 
decrease H q by decreasing At with (T/At) fixed. 

Analogous results for T — * °o with (T/At) fixed are presented in 
Ref. 5, as well as some results on the rate at which H q approaches its 
limiting value. 

Related work on nonuniformly sampling a continuous time inde- 
pendent increment process with one of two drift parameters is available 
in the literature. 14 A typical result is that sampling two stable processes 
with identical characteristic index, skewness, and scale, but differing 
drifts, is a singular detection problem if 

i-o 

diverges, where [tj\ are the sampling epochs, 

t te+i - id = r. 

3=0 

Thus, spacing the samples apart by tj+i — t, <* j- m (m > 1) results in 
singular detection, but (tj+i — tj) « e' mi (m > 0) may not. 
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